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This paper demonstrates the robustness of active queue management 
techniques to varying load, link capacity and propagation delay in a wireless 
environment. The performances of four standard controllers used in 
Transmission Control Protocol/Active Queue Management (TCP/AQM) 
systems were compared. The active queue management controllers were the 


Fixed-Parameter Proportional Integral (PI), Random Early Detection (RED), 


Self-Tuning Regulator (STR) and the Model Predictive Control (MPC). 
Keywords: The robustness of the congestion control algorithm of each technique was 
documented by simulating the varying conditions using MATLAB® and 
Simulink® software. From the results obtained, the MPC controller gives the 
(AQM) . best result in terms of response time and controllability in a wireless network 
Vary link capacity with varying link capacity and propagation delay. Thus, the MPC controller 
Varying network load is the best bet when adaptive algorithms are to be employed in a wireless 
Varying propagation delay network environment. The MPC controller can also be recommended for 

heterogeneous networks where the network load cannot be estimated. 
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1. INTRODUCTION 

The internet as a communication network has been found to exhibit different forms of complex 
dynamic behaviour that can be categorized based on the chaotic behaviour of user flows, flow rate 
oscillations caused by delay, dynamic flow synchronisation passing through a bottleneck link and the 
presence of queues in a router [1]. 

The sharing of a delay prone link between a tangible amount of host clients transport causes the 
protocol incumbent and the TCP variant that is designed to improve the link performance fall short of making 
best use of the communication channel. This shortcoming is neither caused by the control algorithm deployed 
nor the link performance. This limit however, can be attributed to the fundamentals of the TCP protocol [2]. 

The TCP remains the legacy protocol for the transport of packets in the internet backbone; the 
design of the protocol was made to help battle the issue of congestion in a connection-oriented, reliable end- 
end packet delivering IP network. However, this design was made for communication over wired architecture 
because that was the order of the day at that time [3]. 

Nowadays, there has been traffic in the internet due to the wider use of wireless networks (Wi-Fi 
and WLAN). When the legacy TCP is applied to this network, which might be heterogeneous in nature, 
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the congestion control mechanism available leads to reduction in the quality of communication and 
performance of the overall network [4]. 

The Internet Engineering Task Force (IETF) tried to find an alternative solution to the problem by 
proposing the deployment of Active Queue Management (AQM) strategies which combines perfectly with 
the TCP to ameliorate congestions problems. A lot of research is currently underway in the internet 
community regarding the development of a robust and scalable AQM system. The means by which the 
concept of AQM tackles the problem of congestion is to smartly report any congestion before the buffer 
overloads. This is done by sending a signal which can be interpreted in two ways, which are: a) reporting 
huge loss in packets b) increasing the delay, thereby causing packets to be repeatedly sent [5]. This property 
makes the AQM scheme a desirable choice for packet dropping/marking. The parameters used to mark or 
drop packets using active queue management techniques are the queue length and link occupancy. AQM 
schemes are also known for their robustness, and when in use, the network operator requires less tuning on 
the network. This makes the network operator immune to obnoxious network fluctuations [6]. The block 
diagram in Figure 1 shows the relationship between the TCP dynamics and the Queue dynamics. 


u(t) 


TCP Windows Queue 
Dynamics Dynamics 


Figure 1. Block diagram ofa TCP/AQM system [7] 


1.1. The problem 

A lot of algorithms have been proposed to provide optimum queue management in wireless 
networks. These techniques can be classified as classical and modern. The classical techniques include the 
Fixed-Parameter Proportional Integral (PI) and the Random Early Detection (RED). The modern techniques 
are the Self-Tuning Regulator (STR) and the Model Predictive Control (MPC) [8]. Most of the work done on 
adaptive network congestion control techniques only provided the algorithm, but they did not consider the 
effect of varying network conditions on congestion control parameters and the subsequent effect on their 
respective controllers. Most of the proposed algorithms were never tested for robustness. Hence, we cannot 
ascertain the response of their algorithms to changes in the network operating parameters. 


1.2. The proposed solution 

This work shows the robustness of various active queue management controllers to varying network 
parameters. The parameters varied are the network’s Load, link capacity and propagation delay. The effects 
of these varying network parameters on the controllers of the active queue management techniques under 
study were monitored. The results of the simulation study show how the different AQM techniques respond 
to varying network conditions whilst solving the issue of network traffic congestion. 


2. LITERATURE REVIEW 

The Many authors over the years have worked on AQM (Adaptive or Predictive) techniques by 
improving some of the controllers. The authors in [5] proposed an improvement to the PI controller by 
making the response rate of their developed technique to be the function of the queue length error. This 
model saw an increase in the response rate along with increase in the queue length error. The authors in [9] 
proposed an AQM algorithm that works on the principle of combining both the average queue length and the 
estimates of the rate of packet arrival as the control parameter. It is an adaptive algorithm that calculates the 
mean length of the queue, maintaining it so as to keep it constant with a certain reference value. This gives 
rise to high link utilization with significantly lesser delays. The authors in [10] proposed a novel solution 
known as NARED. This is an improvement to the RED algorithm. It introduces the Bufsize parameter to 
implement the adaptive nature of the algorithm by dynamically adjusting the queue length of the incoming 
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packets with respect to the target queue length. This work however did not consider the effect of varying 
network parameters on the proposed solution. The authors in [11] developed a novel algorithm known as 
Model Predictive Active Queue Management (MPAQM). This adaptive technique is based on MPC. 
This algorithm also uses the queue length as the congestion control parameter. They could index the network 
performance to achieve an ideal control function. This work performed extensive simulations to show the 
robustness of their algorithm and could show that their results were better than RED and PI controllers. 
The work however, did not consider the effect of varying network link capacity and propagation delay. 
More recently, the authors in [12] developed an hybrid model which uses PPC technique to solve congestion 
problems in TCP/AQM compliant networks. It also combines backstepping and Ho control 
mechanisms [13]. Their simulation results, like [14], show the robustness of the hybrid algorithm and the 
adaptive nature was also confirmed by varying the network components but did not also consider the effect 
of varying link capacity and propagation delay [15-19]. 


3. RESEARCH METHOD 

This section discusses the various parameters used for the study with the different experiments 
performed. Here, the calculations needed to generate our control parameters chosen for our proposed 
algorithm is determined. 
a. Selection of Controller Parameters: 

Below is the list of control parameters used for the simulation study. This simulation was performed 
using the MATLAB® and Simulink® package. 
The router’s buffer size; qmax=800 packets. 
Queue length (reference); qref=200 packets. 
Initial queue length; qg=150packets. 
The link capacity(bottleneck); c=3750 packets 
The link capacity in Mb/s;c=15Mb/sec. 
Packet size; 500 bytes. 
Recursive Least Squares (RLS) Parameters 

The parameters shown below are derived from empirical calculations and the values obtained are 


DON SOY Bee Sa costo 


listed: 

1. Initialized RLS parameter estimate; 0,= 0. 

2. Parameter estimation covariance matrix initialized as; P = 10001. Where (I) is the identity matrix. 
3. Forgetting factors are initialized as; 1, =0.92; (0) =0.9. 

4. Formula used to update the forgetting factors; 


ACK) = A A(k — 1) + (1 - AQ) (1) 


c. MPC Parameters 
The scalar metrics used in weighting the MPC are: 
1. Q =5, S = 1 (ensures that importance is placed more on minimization of error signal rather than 
penalizing the control effort made). 
2. Prediction horizons: N, = 5 N, = 3 
3. Sampling time: T} = Rọ (to synchronize the MPC to the TCP packet marking dynamics) 
d. STR Parameters 
1. Closed-loop discrete pole: t; = Ro(for closed-loop stability). 
2. Time constant: about 9 samples. 
e. PI Parameters 
The PI controller used in the simulated study, was derived from wireless the established wired 
access network PI controllers. The equations employed for this scenario is stated: 


Jt 
Cp (s) = Kp; P (2) 
+ ELC 
_ 2N _ | Pqueue 
Wg = RHC and Kp; = “Roe (3) 
(2N~)2 
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The conditions necessary for the design of a PI controller which will stabilize the TCP/AQM system 
when employed on wireless network is listed. 


For all N > N` and Ro < R? 


jwg S 
_ 2Nt _ Bgiene = watt 
Wg = epee? SPL = ieg |? Cp, (s) = Kp; s (4) 
CNT)? 


Here, the worst-case scenario i.e. when N-=30 and R+=0.24 results in a value for wg=0.278 and 
KPI=1.3748e—6. This will in turn provide the reference value for the phase margin and it is calculated 
from (5). 


PM = 90° - =w? (5) 


PM ~ 90° — =" w?g = 85.6° (6) 


Where; 

c-Link capacity [Mb/s]; q-Buffer size [Packets]; I-Identity matrix; S-Weights (scalar); Q-Weights (scalar); 
R-Sampling time (Seconds); N-Horizon Nil; t-Pole; C-Transfer function; K-Scaling factor; w-frequency 
(Hertz); A-Forgetting factor; 

6, — Least square parameter; 

Subscripts 

° -Initial; Ref-Reference; Max—Maximum; P-Prediction; U-Control; 1—First; PI-Parameter integral; g-Gain 
Superscripts 

(+)-Increment; (-)}—Decrement 


3.1. Experimental setup 
3.1.1. Simulations on wireless networks 

The topology used for the simulation of the wireless network employed for this experiment is shown 
in the Figure 2. Here, a router is used to create a LAN with two laptop computers wirelessly. From the two 
nodes, it is assumed that several TCP connections are being established and are denoted by N. The Simulink 
model for the TCP/AQM dynamics is shown in Figure 3. 

The wireless conditions that are varied for this experiment are: 
1. Network load 
2. Propagation delay 
3. Link capacity 
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Figure 2. Wireless simulation topology 
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Figure 3. Wireless simulation topology 


3.2. Experiments, results and analysis 

The experiments were conducted by varying the under listed network parameters: 
1. Network loads 
2. Propagation delay 
3. Link capacity because of unresponsive User Datagram Protocol (UDP) flows 

To simulate network loads, File Transfer Protocol (FTP) packets with a longer Time to Live (TTL) 
values are sent through the network. A total of 3750 FTP packets are sent at every second. This is tantamount 
to a link with a bandwidth of 1SMbps and a packet size of 500 bytes. 


3.2.1. Experiments, results and analysis 

To commence the experiment, the load N is set at 500 FTP packets. At time t=30s, 100 more FTP 
packets were injected into the network. This was however stopped at time t=120s. The propagation delay was 
set at Tp=120s. The simulation lasted for 220s. The link capacity of 3750 packets/seconds was maintained. 
All other parameters used are the same with the ones generated above. The result of the experiment is shown 
in Figure 4. 

From the Matlab plot shown in Figure 4, it can be observed that as the load condition changes, MPC 
controllers show a positive response. There was an increase in the drop probability of packets so as to sustain 
the prescribed values of the queue length and window size. The STR controller responded with a change 
which can be said to be oscillatory in nature. The PI controller however shows the weakest response by 
maintaining a constant drop probability and the queue length experienced a rise to a value of 400. The 
response of the RED controller was also weak, but can still be categorized to be better than that of PI. 
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Figure 4. Matlab plots for varying load 


3.2.2. Varying propagation delay 

In order to introduce delay into the simulated network, the delay parameter was varied in a 
continuous fashion. The delays range from 0.04 and 0.2 seconds. The load in the network this time was set at 
100 FTP/seconds. The link capacity remained the initial value of 3750 packets/s. All other parameters were 
held constant and the same with the values used in the previous experiments. The result for this experiment is 
shown in the Figure 5. 
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Figure 5. Varying propagation delay 


From the Matlab plot above, only the MPC has shown a hike in its response and all other controllers 
have been stable. The queue length oscillation for all the controllers is a value of about 50 and it was also 
observed that the regulation for the window size was constant. 


3.2.3. Varying link capacity 

With reference to the initial link capacity which was set at 3750 packets/seconds i.e. 15Mbps, the 
link capacity was varied by using unresponsive UDP packets to reduce the link capacity to 2000 
packets/seconds i.e. 8Mbps at time t=50s. The propagation delay time is set at Tp=0.2s.The simulation lasted 
for a period of 200 seconds and all other parameters remains the same as that of the previous experiments. 
The results of varying the network’s link capacity are shown in the Figure 6. 

From the Matlab plot shown in Figure 5, it can be observed that the PI controller response to the 
sudden change in the link capacity is weak. The drop probability however remains fairly constant which 
extends the queue length to 500. The RED controller shows a better response but its response slowly builds 
up. Out of all the controllers, the MPC shows the fastest convergence in response to the change in the link 
capacity by a quick reduction in the queue length. The MPC instantaneously dropped about three hundred 
300 packets in response to the sudden change in the network link capacity. With the passage of more time, 
the queue length fluctuates between 200 and 500. The STR controller was the most stable of the controllers 
to the sudden change in link capacity with the passage of time. Although it initial response to the sudden 
change in link capacity was quite fast and very unstable. 
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Figure 6. Varying Link Capacity 


4. RESULTS AND ANALYSIS 

From the first experiment i.e. varying network loads, the PI and RED controllers have poor response 
to changes in the amount of FTP packets injected into the network (varying load). This can be attributed to 
the fact that they have fixed values of gains which have hindered their flexibility to generate the required 
control propensity when the load conditions are changed. MPC and STR show better response to the varying 
load due to the adaptive nature of their gain. This flexibility allows for a good control of the changing 
network conditions. MPC also provided the better response of the two because of its capability to predict on 
the horizon. Its computations of control actions are based on optimizing some steps into the future. The STR 
controller’s response was oscillatory at the start of the experiment due to its non-predictive nature. 

a. In the second experiment i.e. varying propagation delay, the MPC shows a very weak adaptability to 
varying delays in the network. Several oscillations are seen at the early stages of the MPC controller, 
especially when the duration of the delays was made uncertain. PI and RED also show similar responses. 

b. From the third experiment i.e. varying link capacity, The MPC and STR had a pretty good adaptability to 
changes in the link bandwidth which is also due to the flexibility in their gain factor. The PI and RED 
were not very scalable when it comes to changing the capacity of the link. 


4.1. Comparison of the controllers 

Starting with the lowest in terms of response of the controller to varying network conditions, the 
performance portrayed by each of the controllers is shown in Table 1. This table scales the controllers as 
good, fair or poor. 
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Table 1. Summary of the Performance of the Controllers 


EXP Network Condition RED PI STR | MPC 
1 Varying Network Load Poor Poor Poor Good 
2 Varying Propagation Delay Fair Fair Fair Fair 
3 Varying Link Capacity Fair Fair Good Good 


5. CONCLUSION 

This paper shows the effect of varying network conditions on four active queue management 
techniques namely; the Fixed-Parameter Proportional Integral (PI), Random Early Detection (RED), Self- 
Tuning Regulator (STR) and the Model Predictive Control (MPC). The simulation results from the Matlab 
plots show that the MPC technique for congestion control demonstrates superior performance under the 
varying network conditions of load, propagation delay and link capacity when compared to Fixed-Parameter 
PI, RED and STR. It is also seen that MPC has the capability to converge faster in all conditions. The STR 
gives the next best result. Therefore, MPC adaptive strategies will be the best algorithm for congestion 
control considering the nature of modern networks. 
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